BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Binding events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[ UTurku ] Binding 347 ( 139) 279 ( 139) 40.06 49.82 44.41
[JULIELab ] Binding 347 ( 172) 488 ( 172) 49.57 35.25 41.20
[ UTokyo ] Binding 347 ( 120) 237 ( 120) 34.58 50.63 41.10
[VIBGhent ] Binding 347 ( 132) 342 ( 132) 38.04 38.60 38.32
[ UZurich ] Binding 347 ( 107) 287 ( 107) 30.84 37.28 33.75
[ SCAI ] Binding 347 ( 100) 284 ( 100) 28.82 35.21 31.70
[UT+DBCLS ] Binding 347 ( 80) 166 ( 80) 23.05 48.19 31.19
[ UNSW ] Binding 347 ( 82) 220 ( 82) 23.63 37.27 28.92
[ Team 24 ] Binding 347 ( 79) 223 ( 79) 22.77 35.43 27.72
[ASU+HU+BU] Binding 347 ( 69) 155 ( 69) 19.88 44.52 27.49
[ConcordU ] Binding 347 ( 71) 175 ( 71) 20.46 40.57 27.20
[CNBMadrid] Binding 347 ( 115) 560 ( 115) 33.14 20.54 25.36
[CIPS-ASU ] Binding 347 ( 60) 190 ( 60) 17.29 31.58 22.35
[ NICTA ] Binding 347 ( 58) 200 ( 58) 16.71 29.00 21.21
[ KoreaU ] Binding 347 ( 45) 90 ( 45) 12.97 50.00 20.59
[ UAveiro ] Binding 347 ( 47) 138 ( 47) 13.54 34.06 19.38
[ UNIMAN ] Binding 347 ( 44) 109 ( 44) 12.68 40.37 19.30
[CCP-BTMG ] Binding 347 ( 44) 110 ( 44) 12.68 40.00 19.26
[ USzeged ] Binding 347 ( 53) 206 ( 53) 15.27 25.73 19.17
[UAntwerp ] Binding 347 ( 45) 145 ( 45) 12.97 31.03 18.29
[ Cam ] Binding 347 ( 44) 138 ( 44) 12.68 31.88 18.14
[ UMich ] Binding 347 ( 110) 872 ( 110) 31.70 12.61 18.05
[ PIKB ] Binding 347 ( 25) 63 ( 25) 7.20 39.68 12.20
[ Team 09 ] Binding 347 ( 11) 112 ( 11) 3.17 9.82 4.79
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Binding 349 ( 78) 166 ( 78) 22.35 46.99 30.29
[ASU+HU+BU] Binding 349 ( 69) 155 ( 69) 19.77 44.52 27.38
[ Team 24 ] Binding 349 ( 76) 228 ( 76) 21.78 33.33 26.34
[CCP-BTMG ] Binding 349 ( 43) 110 ( 43) 12.32 39.09 18.74
[UAntwerp ] Binding 349 ( 41) 145 ( 41) 11.75 28.28 16.60
[CNBMadrid] Binding 349 ( 68) 560 ( 68) 19.48 12.14 14.96
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------